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ABSTRACT 



This document contains the final report of a study 



conducted to test the feasibility of developing and implementing 
instructional modules — for adults in Adult Basic Education and 
English as a Second Language — based on information about text 
processing demands and task difficulty gleaned from past national 
adult literacy surveys. Another objective was to test the 
relationship between the modules and subsequent score gains on the 
Test of Applied Literacy Skills. Thirty-four lessons were developed 
in the two modules; the students who were taught with the lessons 
improved more than the control group. The study concluded that 
literacy programs can use information about cognitive tasks 
discovered in adult literacy surveys to improve their instructional 
programs;. Following the 13-page report are the lesson plans that were 
developed. The lesson sequence by group is outlined. Each module has 
the following parts: lesson segment (focusing, presenting, following 
up, applying, evaluating), activities for each segment, material 
needed, and time length when applicable. (YLB) 
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Cognitive Skills-Based Instruction and As.*:ssment Project 
National Institute For Literacy 

Final Report 

I. Introduction 1 

The purpose of this study was to test trie feasibility of developing and implementing instructional 
modules - to adults in Adult Basic Education (ABE) and English as a Second Language (ESL) classrooms 
- based on information about text processing demands and task difficulty gleaned from past national adult 
literacy surveys. Three national adult literacy surveys conducted by the Educational Testing Service 
(Kirsch, et al., 1986, 1992, 1993) 2 provided information on the types of cognitive skills associated with 
the different levels of achievement from three literacy scales: prose, document, quantitative. Based on 
a review of these cognitive skills, instructional lessons were packaged into two thematic (prose and 
documents) modules and implemented in 4 ABE and 3 ESL classrooms. 

One major objective otthis project was to test the relationship between these instructional 
modules and subsequent gain scores on the Test of Applied Literacy Skills (TALS) - a test born out of 
the Kirsch et al studies mentioned above. 

A secondary objective of the study was to determine if the instructional lessons could be 
developed and implemented within the current course offerings and instructional schedules existing in the 
Los Angeles Unified School District (LAUSD); and whether the cognitive skills identified by the 
curriculum committee showed promise for teaching both ABE and ESL adult learners, and ultimately, 
improving their literacy skills. 

II. Methodolog y 

This study represented three major phases: 1) curriculum development, 2) instruction, and 3) data 
gathering and analyses. 

1, Curriculum Development 

Curriculum Committee. A curriculum committee was selected based on recommendations from 
the LAUSD's Director of Educational Options and Support Services. Initially there were four members, 
then one member took a full-time position outside the district leaving three members. The three 
committee members met on several occasions (schedule included in Mid-Year Report) to prepare for the 
instructional development tasks. First, the committee needed to be well versed on the nature of the Test 
of Applied Literacy Skills (TALS). Initial sessions were devoted to examining the prose, document, and 



1 The Final Report will briefly discuss the rationale for the study and methodology. A more detailed explanation of these components 
can be found in the Mid- Year Report. The Final Report will discuss the results and implications for practitioners. 

2 Kirsch et al. (J 986) Literacy: Profiles of America's Young Adults. Educational Testing Service. Princeton, New Jersey. Report 
No. 16-PL-02.; Kirsch et al.. (1992) Beyond the School Doors. Educational Testing Service. U.S. Department of Labor Employment & Training 
Administration; Kirsch et al. . (1993) Adult Literacy in America: A first Look at the Results of the National Adult Literacy Survey. Educational 
Testing Senice. U.S. Department of Education. 



quantitative components of literacy as defined by the research and assessments conducted by the 
Educational Testing Service. Findings from these major studies were presented to the committee 
members. 

Specifically, results from these studies were reviewed relative to the types of tasks associate with 
different literacy levels. Additionally, related work conducted in Mississippi identifying cognitive tasks 
associated with the Test of Applied Literacy Skills (TALS) was examined. Further, developmental work 
conducted at ETS (Princeton) in interactive video instruction for document literacy tasks was shared with 
the curriculum committee. Finally, prose, document, and quantitative workbooks published by Simon 
& Schuster were distributed to committee members and analyzed for their relevancy to this study. 

In sum, a careful review of related efforts at developing a curriculum related to these past adult 
literacy assessments was conducted. Information gathered from these various sources - although different 
from each other - when considered as a whole - provided valuable information for developing this 
project's curriculum intervention. 

Developing Modules. Once the preliminary background sessions were completed, the 
development of the modules began. It was decided that only two of the three literacy areas identified in 
previous studies would be used in this study. This was done for several reasons. First, the time available 
for instruction totalled 40 hours or 10 weeks. Second, the difficulty level of quantitative literacy tasks 
made committee members feel that we should start with the two easier areas. Finally, other efforts in 
the document and prose scales were under way and provided suggestions on how to proceed or identified 
areas of concern. However, to our knowledge, there were no structured (paper-pencil) instructional 
modules associated with the tasks related to the ETS assessments, nonetheless, much could be learn from 
previous initial curriculum efforts in this area. Two major modules were developed for the prose and 
document literacy domains. The prose module contained 22 lessons and the document module contained 
12 lessons for a total of 34 lessons. 

Important to the developmental process was to get a better understanding of the teaching 
environment in the classrooms to be used for the study. With this in mind, an initial survey was sent out 
to all potential "study" teachers to determine the types of activities and schedules they were currently 
using. Project staff had to determine the initial parameters of the modules; how long they would last, 
and the type of content they would cover, and materials used. 

Based on this information, a Lesson Plan Structure was identified. Each lesson was structured 
into five segments: 1) focusing, 2) presenting, 3) following-up, 4) applying, and 5) evaluating. Each 
segment is briefly described below. 

SEGMENT 1. FOCUSING: In this section learners focus in on the topic or idea of the lesson 
being presented by linking their past experiences with concepts to be covered in the lesson. 

SEGMENT 2. PRESENTING: In this section the teacher presents the actual lesson. Activities 
that the teacher is to do are outlined here. This section has prompts for the teacher. 

SEGMENT 3. FOLLOWING-UP: This section is an extension to the presenting section. It 
continues the lesson with teachers providing learners additional practice with the concepts 
presented in the previous segment. 
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SEGMENT 4. APPLYING: This section allows the learner to apply their knowledge 
by completing worksheets related to the concepts taught earlier. 

SEGMENT 5. EVALUATING: In this section, learners respond to the evaluation 
feedback form. This form asks the learner about the difficulty and relevancy of the 
lesson. 

The Lesson Plan Structure also identifies the materials necessary to implement the instruction 
segment. These materials are included in the packaged module. Finally, the Lesson Plan Structure 
indicates the amount of time the teacher should spend on each segment. This assists the teacher in pacing 
instruction. 

In addition to the Lesson Plan Structure, the modules package also contains the materials needed 
to carry out the lesson. These materials include: 

* the worksheets (usually 1 or 2) 

* the Student Evaluation Form; which is located behind 
the last worksheet 

* transparencies (located in a separate file folder) 

* cassettes (1 module only) 
markers to use with transparencies 

* reading materials, stories, tables, etc., used in the lesson 

All of these materials were included in a prepackaged Banker's BOX and delivered to all teachers 
in the treatment group. The modules were placed in a sequence that teachers were to follow. A Module 
Master List was taped to the box in the event that the modules got placed out of order. 

After the Lesson Plan Structure was developed, topics for the prose and document literacy 
modules were selected. The categories for the prose lessons are presented in Table 1 



Table 1 



Lesson Topics by Module Type 


PROSE MODULE 


DOCUMENT MODULE 


short stories 


simple lists 


textbooks 


combined lists 


newspapers 


intersecting lists 


reference materials 


nested lists 


magazines 


pie charts 


brochures 


bar charts 


poems 


line char s 




forms 



Curriculum committee members were asked to identify materials that - based on their experience 
in the classroom - adults in the ABE and ESL programs would likely come into contact with in their 
daily lives. Based on these observations and the initial teacher classroom practices survey, materials were 
identified for the modules. Materials related to each prose and document literacy area were selected. 
When materials were selected, committee members began fitting the materials and lesson activities into 
the Lesson Plan Structure outlined above. Once in draft form, the committee members brought lessons 
to the project meetings and shared them v/ith other Curriculum Committee members and project staff for 
input and comments. Each lesson went through this revision process until all were completed. 

2. Instruction 

The instructional phase of the study included teacher training, module implementation, and 
classroom record keeping. 

Pre and post testing and administration of learner background questionnaires, while taking place 
in the classroom, are discussed later in this report in the data gatfiering and analyses section. 

Teacher Training. The modules represent a different way to teach adult learners. For example, 
each lesson deals with a specific H real-life" text processing situation e.g., reading a table, schedule, etc.. 
Further, each lesson includes N reaT text samples e.g., newspaper, magazine, almanac, as teaching 
materials. As such, treatment teachers needed to be trained on how to implement the lessons. All 
treatment teachers were provided a one-day training on teaching the modules. The training covered 
implementation of the modules, pacing, integrating materials, and maintaining the instructional LOG. 

Implementing Modules. Before instruction began, classrooms were sampled to identify the 
treatment and comparison classrooms; pretesting of adults took place; and learner background 
questionnaires were administered to participants. These activities will be discussed in the Data Gathering 
and Analysis section of this report. 
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There were 14 classes included in the study. Seven were control group and seven were treatment. 
Six classes were predominantly advanced ESL and eight were predominantly ABE. The increased 
numbers for the ABE classes were done to provide for more ABE learners since these classes typically 
have low enrollments. 

Initial class sizes from registration and/or teacher sources indicated that the ESL classes were 
indeed larger than the ABE classes. Table 2 summarizes the nature of the treatment and control classes. 

Table 2 



Nature of Treatment and Control Classrooms 




TREATMENT 


CONTROL 


Class No. 


No. Students 


Class No. 


No. Students 


ESL Classes 


class 1 


55 


class 1 


55 


class 2 


55 


class 2 


55 


class 3 


55 


class 3 


55 






Class No. 


No. Students 


Class No. 


No. Students - 


ABE Classes 


class 1 


25 


class 1 


25 


class 2 


15 


class 2 


20 


class 3 


15 


class 3 


15 


class 4 


30 


class 4 


15 


Note: Qasses 1,2,3 had same treatment & control teacher. 



The configuration for the ABE treatment and control groups was different than that of the ESL 
group. The ESL classrooms each had one treatment and one control teacher. However, the ABE 
classrooms were configured differently. Since teachers in the ABE program taught back-to-back classes 
for longer periods of time, and since there were relatively fewer classes to choose from, each ABE 
teacher selected one class for treatment and one class for control. There are pros and cons to this type 
of design. 

This design is acceptable in that one can control for "teacher effects." Secondly, by sampling 
from the same school or center, one draws from the same community thus controlling somewhat for 
neighborhood and/or "background effects. One problem with this design is that the teacher might teach 
the treatment materials to the control group (which they were instructed not to do),and secondly, not 
being familiar with the new treatment materials (modules) might not teach as effectively if the materials 



were more familiar. Nonetheless, the reality of the ABE context (i.e., class size) made this design 
acceptable. 

Instructors for the treatment group were provided with the pre-packaged self-contained modules 
delivered in three sets. Ail modules were self-contained in that all necessary duplications of handouts, 
transparencies, activity sheets and evaluations were included in the packaged module. Sets of 10 modules 
were packaged in banker's boxes and delivered to the appropriate treatment classroom teacher. Once 
these ten modules were completed, another ten were delivered until all 34 lessons were delivered to the 
teacher. Overhead projectors were provided by the ABE and ESL programs. Instruction lasted for 10 
weeks. 

Both ESL and ABE treatment group instructors were to teach one module per class session. Each 
module lasted around one hour. The implementation of the modules and lessons were the key to the 
treatment group intervention. To determine the extent to which the lessons were implemented, and the 
extent to which other materials or subjects were taught along side the modules, teachers were asked to 
maintain a curriculum LOG, which is described in the next section. 

Classroom Record Keeping: Curriculum Logs. The purpose of the study was to determine if 
lessons based on text-processing skills associated with national studies/surveys v/ould improve the literacy 
levels of adult ESL and ABE students. To determine this, instructional lessons related to the text- 
processing demands, associated materials and contexts were developed for classroom use. Research staff 
needed to determine, however, to what extent the study modules were being implemented and to what 
extent "other" instruction was being provided in the treatment classrooms. Further, staff needed to know 
what type of instruction was taking place in the comparison classrooms as well. Therefore, to get a better 
understanding of the instructional process for both the treatment and comparison groups, teachers were 
asked to maintain a curriculum LOG describing each of their class sessions. 

The treatment group curriculum LOGs asked the teacher to indicate the extent to which each 
segment of the lesson plan was implemented for each (all 34 lessons) lesson; if other activities related to 
the lesson took place; whether other materials were used that related to the lesson; and, the extent that 
other activities and materials not related to the lesson were used during the class time. Finally, a general 
comments section was included. 

The comparison group curriculum LOGs consisted of a weekly lesson plan that asked the teacher 
to describe - on a daily basis - the theme and/or activity for the day and the materials used. 

3, Data Gathering and Analyses 3 

Sampling. Care was taken to ensure that the teachers were evenly divided between the treatment 
and comparison groups relative to teaching experience. A teacher questionnaire was developed (described 
earlier) to assist project staff in identifying and selecting comparison and treatment teachers and 
classrooms. Background information including teaching experience and subject matter taught were taken 
into consideration. 



Testing schedules and questionnaires used in this study are available in the Mid-Year Report. 
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Based on these data and recommendations from the curriculum committee members, who in most 
cases knew of the teachers, comparison and treatment classrooms were selected. 



Adults were selected to participate in this project if they attended one of the LAUSD's Adult 
Basic Education (ABE) or English as a Second Language (ESL) classes. In order to control for 
background variation to the extent possible, care was taken to select adults from the same geographic 
region and school. ABE and ESL classes were identified with the assistance of the LAUSD ABE staff. 

Pretesting, All classrooms (treatment and comparison) were involved in the pre-testing phase. 
The Test of Applied Literacy Skills (TALS) PROSE Form A and DOCUMENTS Form A was 
administered to the adults. Additionally, the Test of Adult Basic Education (TABE) Level M Form 5 was 
administered as well. 4 The testing schedule is included in the Mid-Year Report. 

Learner Background Questionnaire. A learner background questionnaire was also administered 
to determine the characteristics of the adults in each classroom. That is, the educational background of 
the adults, demographic characteristics, and so forth. 

Post-testing. Sets of the TALS and TABE were prepared along with test administration 
instructions and testing schedule to the classrooms. The teachers administered the pre-tests to the students 
at the beginning of the instruction cycle. After the 12 week cycle, teachers administered the post-test 
PROSE Form B and DOCUMENTS Form B as well as the TABE Level M Form 6. 

For both the pre and post testing phases of this study, make-up days were scheduled for those 
adults who were unable to be tested on consecutive sessions. 

Scores from the TALS pre and post tests for prose and document scales were scored by two 
readers. Each reader scored several tests then traded scored tests to determine their reliabilities in 
scoring. Once raw scores were produced, they were matched to the conversion table available from the 
publisher to produce a scaled score. 

Analyses. The analyses for this study represent three forms: 1) development of the curriculum, 
2) implementing the curriculum, and 3) determining progress through the analysis of pre and post tests. 
The development phase is analyzed relative to the end product. That is, were the lessons (curriculum) 
indeed produced and made available to teachers. The second phase is analyzed relative to the level of 
implementation of the lessons. This phase examines the number of lessons implemented and the extent 
to which each lesson was completed. The curriculum LOGs served as the major data source for this 
analysis. The final phase examines the nature of progress that adults made vis a vis pre and post testing 
using the Test of Applied Literacy Skills (TALS) in the Prose and Document literacy areas. 
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TA BE results are not analyzed in this report. 
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III. Results 



1. Development of Modules 

Thirty-four lessons representing the two Prose and Document modules were developed. The 
lesson plan structure with associated activity sheets, transparencies, and selected instructional materials 
were packaged and sent to each treatment classroom teacher. The curriculum committee developed the 
lessons and ETS (Pasadena) packaged them for the teachers. As Table 1 illustrates, the modules were 
successfully developed and packaged for the teachers to implement in their classrooms. 

2. Implementation of Modules 

To determine the extent to which the modules were implemented in the treatment classrooms, 
teachers were asked to maintain curriculum LOGs which were developed by the study research staff. 

LOGs were received from 5 of the 7 treatment teachers. 5 Three teachers taught all 34 modules. 
One taught 24 of the 34, and one taught 15 of the 34. All but one teacher implemented every segment 
of the lesson plan. 

Teachers made positive comments on 24 of the lessons. The newspaper 2 lesson was the most 
popular. This lesson generated interest and responses from the students — both advanced ESL and ABE. 
The lessons dealing with textbooks and short stories were also popular with the students. Teachers 
described students getting involved in the discussions, providing personal stories relating to the lesson, 
and generally showing interest. One student went out and bought a book relating to the story. 

Lessons that taught about the different types of lists (simple, combined, intersecting, nested) 
people use in everyday life were well-received. Along this same line, lessons on charts were successful 
because they were "visual and simple to do." Teachers noted that students enjoyed the lessons and that 
they were easy to present. Magazine topics were also popular because of the students' familiarity with 
magazines, and because of the topics covered in the lessons. 

Teachers also found some of the lessons difficult to implement because of time constraints, that 
is, they needed more time to carry out the lesson segments (i.e., focusing, presenting, evaluating). In 
some cases, idioms used were difficult for the ESL students. The reading levels of some of the handouts 
were difficult for some students, and skills such as inferential thinking, getting the main idea and drawing 
conclusions were difficult for some students. 

Judging from the topics and formats of the lessons used in this study, it is clear that this type of 
instruction is different. However, to determine how different, staff needed to analyze the type of 
instruction provided adults in the comparison groups. Information from the curriculum LOG% and the 
curriculum committee members shed light on this aspect of instruction. 

Generally, the comparison programs did a substantial amount of work in the areas of vocabulary, 
grammar, dictionary work, spelling, oral language exercises, synonyms, and antonyms. Tests were 



One ABE teacher experienced great difficulty in implementing the study lessons and generally in participating in the study. For 
all intent purposes, this class >- which was relatively small - was deleted from the study. 
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regularly given in some classrooms in spelling and vocabulary. Comparison classrooms provided 
instruction in reading "comprehension", however, it is not clear from the LOGs what this involved. In 
some cases, classrooms used commercially developed texts that included reading and writing skills as well 
as vocabulary and spelling tests. 

An analysis of the comparison classroom LOGs demonstrates that the instruction provided is 
substantially different from the prose and document modules provided the treatment classrooms. 

3, Improvements in Adult Literacy Progress 

This section will review the results of the TALS pre-post testing conducted in the treatment and 
comparison groups. TALS test data will be presented for ESL and ABE classrooms separately. Only 
adults with matched scores (i.e., a pre and post test score for either the prose and document tests) were 
included in the analyses. A total of 160 ESL adults fit this criteria for the treatment group (81 documents 
& 79 prose); while 68 (41 documents & 27 prose) ESL adults fall into the comparison group. Fifty-eight 
(31 documents & 27 prose) ABE adults composed the treatment group while only 5 (2 documents & 3 
prose) made up the comparison matched-group category. Needless to say, this latter group provided little 
useful information. 

For the ESL classrooms, there were three treatment and three comparison classrooms. Changes 
in the pre and post test median scaled scores on the prose and document literacy tests are presented in 
Table 3. The data show that overall, the treatment group improved more than did the comparison group. 
For example, improvements ranged from 30 to 50 points on the document test and 40 to 50 points on the 
prose test. 

Interestingly, classrooms 2 and 3 were considered high implementors of the lessons based on an 
analysis of the curriculum. LOGs. They, in fact, improved slightly more than classroom I (range from 
10 to 20 points), which did not implement the modules as thoroughly. 

For the ABE classrooms, there were four treatments and four comparison groups. Changes in 
the pre and post test scores on the prose and document literacy tests for this group are also presented in 
Table 3, The data show that similar to the ESL results, treatment classes from 20 to 30 points in the 
assessments. However, in this case, there were too few cases in the comparison group to make reliable 
interpretations. Within the treatment group, changes in median scaled scores from pre to post testing 
were evident. Classroom 4 made the greatest gains 60 points in documents and 50 points in prose. This 
teacher was considered a conscientious implementer of the modules. 
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Table 3 



Median Scaled Scores for Test of Applied Literacy Skills, 
Prose and Document Literacy: Treatment and Comparison Groups 

ESL 



Treatment 


Comparison 


Class 


Doc's 
Pre-Test 


Doc's 
Post- 
Test 


Prose 
Pre-Test 


Prose 
Post- 
Test 


Class 


Doc's 
Pre- 
Test 


Doc's 
Post- 
Test 


Prose 
Pre-Test 


Prose 
Post- 
Test 


1 


240 


270 


240 


280 


1 


230 


240 


220 


230 


2 


220 


260 


210 


260 


2 


210 


220 


190 


200 


3 


210 


260 


220 


270 


3 


260 


280 


240 


260 


Total 
Avg. 


220 


260 


230 


270 


Total 
Avg. 


230 


250 


220 


240 



ABE 



Treatment 


Comparison 


Class 


Doc's 
Pre-Test 


Doc's 
Post- 
Test 


Prose 
Pre-Test 


Prose 
Post- 
Test 


Class 


Doc's 
Pre- 
Test 


Doc's 
Post- 
Test 


Prose 
Pre-Test 


Prose 
Post- 
Test 


I 


220 


240 


220 


240 


l 


240 


210 


220 


240 


2 


210 


240 


240 


240 


2 


230 


240 


ND 


ND 


3 


ND 


ND 


ND 


ND 


3 


ND 


ND 


ND 


ND 


4 


220 


280 


240 


290 


4 


ND 


ND 


ND 


ND 


Total 
Avg. 


220 


270 


240 


270 


Total 
Avg. 


230 


220 


220 


240 



Generally, both treatment and comparison groups improved their scores over time, yet the 
treatment group improved by more, and within this group, those teachers who implemented the modules 
more thoroughly improved more than those who did not. The fact that the treatment group improved 
more relative to their pre test suggests that the intervention (i.e., lessons) could be partly responsible. 
The distinction between the instruction in the treatment and comparison group classrooms was determined 
to be evident. The reader is cautioned that the numbers of matched pairs in some ABE groups were too 
low to make comparisons or derive any meaning from the scores. 
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4, Caveats 



The reader should understand that this study did experience some difficulties that should be kept 
in mind while interpreting the results. For example, there were sampling constraints in that "intact" 
classrooms were used. Sometimes there are internal biases or criteria in creating and/or organizing 
classrooms. Also, the ESL students ranged from level 4-6. The lower level learners had difficulty with 
some English concepts and vocabulary on both the lessons and tests used. In this case, language 
proficiency rather than English skills could have negatively effected the outcomes - especially if the test 
"bottoms out" too high. At least one ABE classroom had scheduling difficulties and other problems thus 
resulting in very low implementation relative to testing and implementation of the modules. This situation 
reduced the overall total number of participants. Scheduling in general was complex - some classrooms 
were only an hour long while others were two or more hours. This created a constraint on those 
classrooms that needed more time to complete the lessons — which were intended to last one hour but in 
some cases took longer. 

As described earlier in this report, some teachers represented both treatment and comparison 
groups. Even though they were instructed to separate tlieir instructional program, there could have been 
instructional "slippage." Although means of scaled scores for prose and document tests between treatment 
and comparison groups were different, with treatment scores being higher, no statistical tests of 
significance were performed at this time. Finally, as with any major study of this kind, there is attrition, 
thus causing missing data. In some cases curriculum LOGs were not returned, or tests not administered 
because students left the program. This caused a problem with matched data — which formed the basis 
of the pre-post test analyses. 

IV. Discussion of Finding s 

The findings of this study are promising. First, this study found that instructional lessons that 
reflect the text-processing demands that adult learners come into contact with can be provided to both 
advanced ESL learners and ABE students. Secondly, lessons in this instructional format can be 
implemented in both ESL and ABE classrooms. These lessons can be of high-interest and informative 
to adults participating in these programs. Although adults in these programs usually receive grammar- 
based instruction and materials, they can adapt to new approaches when the interest level is high, and 
where topics and materials are relevant to their lives. As discussed earlier in this report, the majority 
of the lessons were well-received by adult participants. 

The third issue addresses the impact that these lessons have on adult learners' literacy progress. 
This study used the Test of Applied Literacy Skills (TALS) to determine this. Apparently, judging from 
pre-post test results, this type of instruction can have a positive effect on adult literacy progress - 
although tests of statistical significance were not conducted. Nonetheless, this finding is encouraging 
because it suggests that curriculum can be developed that mirrors the assessment process - and instruction 
using this curriculum can improve literacy levels. 

The curriculum lessons were developed to teach about the structure, purpose, and context of 
literacy tasks using everyday materials and situations (contexts). These everyday situations involve text- 
processing demands that can be taught using relevant and interesting materials. The first and second parts 
of this study - developing and implementing these lessons - found that this process is indeed possible. 
The third part of the study - the assessment - found that learners' scores from pre to post testing can 
improve as well with instruction in this area and possibly better than if using grammar-based approaches. 

11 
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While keeping the caveats described above in mind, this study provides documentation that an 
instructional program can be developed that links skills and text- processing demands contained in a 
national assessment. And secondly, that instruction can improve learners' literacy levels vis a vis the 
national assessment; in this case scores on the TALS. 

V. Implications of Findings for Improving Practice 

This study was conceptualized to improve adult literacy practice. An issue in instruction at all 
levels of education is the linkage between assessment and curriculum. On too many occasions, programs 
test adults on one set of criteria, and teach another. Because of this mismatch, literacy growth is either 
unrealized or unexplainable — that is, it cannot be related to instruction. 

Another issue this study tried to resolve dealt with materials used in adult literacy classes. Could 
materials be developed that related to adults' experiences, text-processing demands, and interests, and still 
be cognitively demanding? On this note, results show that adults enjoyed many of the lessons provided 
them while they learned new concepts. Probably most encouraging about the materials issue is that the 
content of the lessons can be interchangeable. For example, the bus schedule or menu one uses to teach 
columns and rows, and intersecting lists could come from the learner's neighborhood. Short stories could 
come from various cultural writings — its the underlying cognitive skills that are important. It is the text 
processing demands associated with literacy tasks that need to be taught — the content can be locally 
developed. 

The question now becomes, how do we teach text structure, not what text do we use. How do 
we teach adults to understand the purpose of any given task relative to its context? This study shows that 
these issues can be addressed in instructional lessons. And while adult educators can probably think of 
additional ways to bring this concept across, this study at least shows that others ways are possible and 
probably needed to serve different contexts. 

Adult literacy programs can develop their own curriculums that teach content, structure, and 
purpose. Within these categories, practitioners need to identify the underlying cognitive skills and/or text 
processing demands associated with the different difficulty levels. The national adult literacy assessments 
described earlier in this report have identified the various skills associated with the different prose and 
document levels. Some of the^tf skills involve simple matching of information while the more difficult 
levels require integrating or synthesizing information. By using instructional lessons tied to these skills, 
local programs can compare their assessment results with those of the nation or in some cases with those 
of the state or some special population (i.e., prison) 

In sum, adult literacy programs can use the information from this study to begin to develop 
lessons and curriculum that relate to their specific situation incorporating materials and contexts that are 
relevant to their learners. In doing so, programs can identify text-processing demands that are most 
problematic for their learner populations and teach them in a sequential manner. By emphasizing the 
structure and purpose of various literacy-related tasks in the lessons, programs can choose the content 
areas important to their learners. These three components — structure, content and purpose — will teach 
adults the skills that researchers have identified as being tied to difficulty of tasks in large-scale adult 
literacy assessments. By teaching these skills, local programs would be taking major steps in integrating 
curriculum and assessment — and because of this match, literacy improvement can be realized and 
explained. 
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Lesson Sequence Form 



Group 1: Short Stories 1, Prose 

Reference Materials 1, Prose 
Simple Lists 1, Document 
Newspaper 1, Prose 
Pie Charts 1, Document 
Magazines 1, Prose 
Short Stories 2, Prose 
Simple Lists 2, Document 
Reference Materials 2, Prose 
Short Stories 3, Prose 
Forms 1, Document 
Brochures 1, Prose 

Group 2: Magazines 2, Prose 

Combined Lists 1, Document 
Newspaper 2, Prose 
Text Books 1, Prose 
Forms 2, Document 
Short Stories 4, Prose 
Poems 1, Prose 

Intersecting Lists 1, Document 
Text Books 2, Prose 
Newspaper 3, Prose 
Bar Charts 1, Document 
Reference Materials 3, Prose 

Group 3: Newspaper 4, Prose 

Intersecting Lists 2, Document 
Text Books 3, Prose 
Short Stories 5, Prose 
Pie Charts 2, Document 
Magazines 3, Prose 
Text Books 4, Prose 
Nested Lists 1, Document 
Short Stories 6, Prose 
Line Graphs 1, Document 



NOTE : Group 1 lessons included in Mid-Year Report 
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